Machine learning models to predict the maximum severity of COVID-19 based on initial hospitalization record.

Background: As the worldwide spread of coronavirus disease 2019 (COVID-19) continues for a long time, early prediction of the maximum severity is required for effective treatment of each patient. Objective: This study aimed to develop predictive models for the maximum severity of hospitalized COVID-19 patients using artificial intelligence (AI)/machine learning (ML) algorithms. Methods: The medical records of 2,263 COVID-19 patients admitted to 10 hospitals in Daegu, Korea, from February 18, 2020, to May 19, 2020, were comprehensively reviewed. The maximum severity during hospitalization was divided into four groups according to the severity level: mild, moderate, severe, and critical. The patient's initial hospitalization records were used as predictors. The total dataset was randomly split into a training set and a testing set in a 2:1 ratio, taking into account the four maximum severity groups. Predictive models were developed using the training set and were evaluated using the testing set. Two approaches were performed: using four groups based on original severity levels groups (i.e., 4-group classification) and using two groups after regrouping the four severity level into two (i.e., binary classification). Three variable selection methods including randomForestSRC were performed. As AI/ML algorithms for 4-group classification, GUIDE and proportional odds model were used. For binary classification, we used five AI/ML algorithms, including deep neural network and GUIDE. Results: Of the four maximum severity groups, the moderate group had the highest percentage (1,115 patients; 49.5%). As factors contributing to exacerbation of maximum severity, there were 25 statistically significant predictors through simple analysis of linear trends. As a result of model development, the following three models based on binary classification showed high predictive performance: (1) Mild vs. Above Moderate, (2) Below Moderate vs. Above Severe, and (3) Below Severe vs. Critical. The performance of these three binary models was evaluated using AUC values 0.883, 0.879, and, 0.887, respectively. Based on results for each of the three predictive models, we developed web-based nomograms for clinical use (http://statgen.snu.ac.kr/software/nomogramDaeguCovid/). Conclusions: We successfully developed web-based nomograms predicting the maximum severity. These nomograms are expected to help plan an effective treatment for each patient in the clinical field.

Prediction Models for the Clinical Severity of Patients With COVID-19 in Korea: Retrospective Multicenter Cohort Study.

BACKGROUND: Limited information is available about the present characteristics and dynamic clinical changes that occur in patients with COVID-19 during the early phase of the illness. OBJECTIVE: This study aimed to develop and validate machine learning models based on clinical features to assess the risk of severe disease and triage for COVID-19 patients upon hospital admission. METHODS: This retrospective multicenter cohort study included patients with COVID-19 who were released from quarantine until April 30, 2020, in Korea. A total of 5628 patients were included in the training and testing cohorts to train and validate the models that predict clinical severity and the duration of hospitalization, and the clinical severity score was defined at four levels: mild, moderate, severe, and critical. RESULTS: Out of a total of 5601 patients, 4455 (79.5%), 330 (5.9%), 512 (9.1%), and 301 (5.4%) were included in the mild, moderate, severe, and critical levels, respectively. As risk factors for predicting critical patients, we selected older age, shortness of breath, a high white blood cell count, low hemoglobin levels, a low lymphocyte count, and a low platelet count. We developed 3 prediction models to classify clinical severity levels. For example, the prediction model with 6 variables yielded a predictive power of >0.93 for the area under the receiver operating characteristic curve. We developed a web-based nomogram, using these models. CONCLUSIONS: Our prediction models, along with the web-based nomogram, are expected to be useful for the assessment of the onset of severe and critical illness among patients with COVID-19 and triage patients upon hospital admission.

Clinical Characteristics and Outcomes of COVID-19 Cohort Patients in Daegu Metropolitan City Outbreak in 2020.

BACKGROUND: A coronavirus disease 2019 (COVID-19) outbreak started in February 2020 and was controlled at the end of March 2020 in Daegu, the epicenter of the coronavirus outbreak in Korea. The aim of this study was to describe the clinical course and outcomes of patients with COVID-19 in Daegu. METHODS: In collaboration with Daegu Metropolitan City and Korean Center for Diseases Control, we conducted a retrospective, multicenter cohort study. Demographic, clinical, treatment, and laboratory data, including viral RNA detection, were obtained from the electronic medical records and cohort database and compared between survivors and non-survivors. We used univariate and multi-variable logistic regression methods and Cox regression model and performed Kaplan-Meier analysis to determine the risk factors associated with the 28-day mortality and release from isolation among the patients. RESULTS: In this study, 7,057 laboratory-confirmed patients with COVID-19 (total cohort) who had been diagnosed from February 18 to July 10, 2020 were included. Of the total cohort, 5,467 were asymptomatic to mild patients (77.4%) (asymptomatic 30.6% and mild 46.8%), 985 moderate (14.0%), 380 severe (5.4%), and 225 critical (3.2%). The mortality of the patients was 2.5% (179/7,057). The Cox regression hazard model for the patients with available clinical information (core cohort) (n = 2,254) showed the risk factors for 28-day mortality: age > 70 (hazard ratio [HR], 4.219, P = 0.002), need for O2 supply at admission (HR, 2.995; P = 0.001), fever (> 37.5°C) (HR, 2.808; P = 0.001), diabetes (HR, 2.119; P = 0.008), cancer (HR, 3.043; P = 0.011), dementia (HR, 5.252; P = 0.008), neurological disease (HR, 2.084; P = 0.039), heart failure (HR, 3.234; P = 0.012), and hypertension (HR, 2.160; P = 0.017). The median duration for release from isolation was 33 days (interquartile range, 24.0-46.0) in survivors. The Cox proportional hazard model for the long duration of isolation included severity, age > 70, and dementia. CONCLUSION: Overall, asymptomatic to mild patients were approximately 77% of the total cohort (asymptomatic, 30.6%). The case fatality rate was 2.5%. Risk factors, including older age, need for O2 supply, dementia, and neurological disorder at admission, could help clinicians to identify COVID-19 patients with poor prognosis at an early stage.